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© Method and apparatus for motion vector estimation using block matching. 



© For many applications it is necessary to be able 
to estimate the velocity of objects in a television 
signal over a large range of velocities. The signal 
processing to perform this task, e.g. block matching, 
requires often large and expensive hardware im- 
plementations. In consumer applications, the cost of 
providing an estimate of velocities over a very large 
range is prohibitively high. As block matching is 
computationally intensive, real-time hardware imple- 
mentations of this technique implement some form 
of parallel processing. The most common form is to 
have one block matching processor per candidate 
motion vector. 

To reduce the computational power, one solution is 
to cover the same numerical range of motion, but 
with decreased accuracy. Another solution is to limit 
the search range at some maximum value. Combina- 
tions of both methods can be used. The cost and 
complexity of such a system can also be reduced by 
providing a non-uniform measurement of possible 
motion vectors. 
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The present invention relates to a method for 
motion vector estimation using block matching. 

Background 

Block matching is a well known technique for 
the estimation of motion in television pictures. Such 
a technique finds application in diverse areas such 
as standards conversion (for example, 50Hz to 
60Hz), bit rate reduction coding and display rate 
upconversion. For most applications, it is neces- 
sary to be able to estimate the velocity of objects 
in the television signal over a large range of veloci- 
ties. The signal processing required to perform this 
task is quite high, and this often results in large 
and expensive hardware implementations. In con- 
sumer applications, the cost of providing an es- 
timate of velocities over a very large range is 
prohibitively high. 

Invention 

It is one object of the invention to disclose a 
method reducing the amount of hardware required 
for performing motion vector measurement. This 
object is reached by the method disclosed in claim 
1. 

Typically, in a block matching motion estima- 
tion system as depicted in Fig. 1, the current field 
or frame CF of the picture is divided into rectangu- 
lar blocks. For each current block, a search is 
made over overlapping blocks within a search win- 
dow SW in the previous field or frame PF to find 
the one that matches the current field block CF the 
best according to some criterion, typically mean- 
square or mean absolute error. The relative posi- 
tion of the two blocks gives the displacement, or 
motion, vector MV for the current block CB. This 
principle holds whether single or double sided 
block matching is used. The advantages of double 
sided block matching are described in another pat- 
ent application (internal ref. D93/067I) of the ap- 
plicant. The motion vectors can e.g. be used for 
calculating an interpolated field IP. 

As block matching is computationally intensive, 
real-time hardware implementations of this tech- 
nique implement some form of parallel processing. 
The most common form is to have one block 
matching processor per candidate motion vector. 
The cost and complexity of such a system can be 
reduced by providing a non-uniform measurement 
of possible motion vectors. 

In principle, the inventive method is suited for 
motion vector estimation using block matching by 
calculating said motion vector using a non-uniform 
measurement of candidate motion vectors within a 
related search window. 

Advantageously, the accuracy of said measurement 



is made non-uniform within said search window by 
dividing the window into, at minimum, an area of 
high precision and an area of lower precision, 
whereby the density of the used pixel values of the 
5 input signal for said motion vector calculation is 
less than in said area of less precision. 

Advantageous additional embodiments of the 
inventive method are resulting from the respective 
dependent claims. 

w 

Drawings 

Preferred embodiments of the invention are 
described with reference to the accompanying 
75 drawings, which show in: 

Fig. 1 principle of one-sided block matching 
applied to intermediate field interpola- 
tion; 

Fig. 2 typical architecture for performing 
20 one-sided block matching; 

Fig. 3 coverage of velocity range ±4 pixels 

with limited 2 pixel accuracy; 
Fig. 4 limited estimation range of ±4 pixels 
horizontally and ±2 lines vertically with 
25 1 pixel accuracy; 

Fig. 5 example configuration of reduced cov- 
erage of motion vector processors. 
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Preferred embodiments 



An example hardware implementation for a sin- 
gle sided block matching scheme is shown in Fig. 
2. Each processing element PE accumulates the 
errors between the pixels (which form a group 

35 related to a candidate block position and vector, 
respectively) arriving at its two inputs, storing par- 
tial results in order to arrive at a total error for each 
block. The processing elements are connected to- 
gether by means not shown in the figure in order to 

40 find which one yields the minimum error for each 
block. All the processing elements PE have a com- 
mon input INP, corresponding to the current block. 
The relative displacements between the pixels in 
the search window are provided by a network of 

45 line LD and sample SD delays that follow the field 
delay FD connected to input INP. This implementa- 
tion allows the measurement of velocities of up to 
±2 pixels or lines in the horizontal and vertical 
directions. Each processing element PE matches, 

so in parallel, the current block CB with those in the 
previous field or frame displaced by ±2 pixels or 
lines. 

In order to give good results in all cases, the 
block search range should cover all possible mo- 
ss tion vectors which may be present in the incoming 
signal. As the number of processing elements is 
directly related to the complexity, and hence cost, 
of the hardware implementation, there is some in- 
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centive to minimise the number of candidate vec- 
tors which must be checked. 

There are two means of reducing the number of 
motion vectors to be considered. One solution is to 
cover the same numerical range of motion, but with 5 
decreased accuracy as shown in Fig. 3. The other 
solution is to limit the search range at some maxi- 
mum value as depicted in Fig. -4, where the vertical 
search range is reduced in comparison to Fig. 3. 
Combinations of both methods can be used. The 10 
circles PSMV represent a possible site of a motion 
vector processor and the points SMV a used site of 
a motion vector processor in the two-dimensional 
Vy/ V h velocity domain. 

The distribution of motion vector processors 75 
can be selected from criteria such as hardware 
complexity limitations or the statistical distribution 
of velocities within the sequences of images. 
An example of such a non-linear distribution of 
motion vector processors is shown in Fig. 5. There 20 
is a dense concentration of motion vector proces- 
sors to measure low velocities within an area AHP 
of high precision. Higher horizontal velocities than 
vertical velocities are supported. There is a reduc- 
tion in precision above a certain velocity within an 25 
area ALP of less precision. Diagonal velocities are 
not well covered within an uncompensated region 
UCR. 

It should be noted that in the area of low precision 
measurement each motion vector processor works . 30 
with reduced precision versions of the input signal. 
These may be generated by spatially low pass 
filtering and then subsampling the input signal. 
The example shown in Fig. 5 depicts a scheme 
whereby the accuracy of the estimated motion de- 35 
creases as the velocity of the motion increases. 
Regions of low velocity are measured the most 
accurately, regions of medium velocity are mea- 
sured with reduced precision, and regions of high 
velocity are not measured at all. Such a scheme is 40 
suitable for the implementation of some of the 
applications noted in the introduction, for example 
to take advantage of the reduced ability of the 
human visual system to track motion in a TV image 
as the speed of an object or pan increases. How- 45 
ever, applications may exist where the distribution 
of the precision of motion estimation is different. All 
such distributions are possible, but there is one 
important criterion which must be satisfied. As the 
overall range of motion vector estimation is limited, 50 
it is implicitly assumed that if no good motion 
vector match is found, then the actual motion is 
outside the range of motion supported by the im : 
plementation. Therefore, in order to avoid ambigu- 
ous results, there should be no isolated unsuppor- 55 
ted regions within the measured range of velocities. 



Claims 

1. Method for motion vector estimation using 
block matching, characterised in calculating 
said motion vector (MV) using a non-uniform 
measurement of candidate motion vectors 
within a related search window (SW). 

2. Method according to claim 1, characterised 
in that the accuracy of said measurement is 
made non-uniform within said search window 
(SW) by. dividing the window into, at minimum, 
an area of high precision (AHP) and an area of 
low precision (ALP), wherein the density of the 
used pixel values of the input signal for said 
motion vector calculation is less than in said 
area of high precision. 

3. Method according to claim 1 or 2, charac- 
terised in ".that said search window (SW) is 
rectangular and includes one or more uncom- 
pensated regions (UCR), in particular in diag- 
onal direction. 

4. Method according to any of claims 1 to 3, 
characterised in that a double-sided block 
matching is used to calculate said motion vec- 
tor (MV). 

5. Method according to any of claims 1 to 4, 
characterised in that the height and the width 
of said search window (SW), or areas, are 
different. 

6. Method according to any of claims 1, 4 or 5, 
characterised in that the accuracy of said 
measurement is made non-uniform within said 
search window (SW) by reducing the density 
of the used pixel values of the input signal for 
said motion vector calculation. 

7. Method according to any of claims 1 to 6, 
characterised in that said motion vector es- 
timation is made for standards conversion, bit 
rate reduction coding and/or display rate up- 
conversion. 
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